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Abstract. A classical linear group G < GL(n) acts on d-tuples of 
n x n matrices by simultaneous conjugation. Working over an infinite 
field of characteristic different from two we establish that the ideal of 
free relations, i.e. relations valid for matrices of any order, between 
generators for matrix 0(n)- and S^(n)-invariants is zero. We also prove 
similar result for invariants of mixed representations of quivers. 

These results can be considered as a generalization of the character- 
istic isomorphism ch : S — > J between the graded ring S = ®^L Sd, 
where Sd is the character group of the symmetric group Sd, and the in- 
verse limit J with respect to n of rings of symmetric polynomials in n 
variables. 

As a consequence, we complete the description of relations between 
generators for 0(n) -invariants as well as the description of relations for 
invariants of mixed representations of quivers. We also obtain an inde- 
pendent proof of the result that the ideal of free relations for GL(n)- 
invariants is zero, which was proved by Donkin in [Math. Proc. Cam- 
bridge Philos. Soc. 113 (1993), 23-43]. 
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1. Introduction 

We assume that F is an infinite field of arbitrary characteristic p = charF. All 
vector spaces, algebras and modules are over F and all algebras are associative with 
unity unless otherwise stated. 

1.1. Matrix invariants. Consider a group G from the list GL(ri), 0(n) = {A £ 
F" x " AA T = E}, Sp(n) = {A e F nx ™ | AA* = E}, where we assume that p ^ 2 
in case G is 0(n) and n is even in the case of Sp(n). Here F nxn is the space of 
n x n matrices over F and A* = —JA T J is the symplectic transpose of A, where 

J = ( ^ ^ ~\ is the matrix of the skew-symmetric bilinear form. The group G 

acts on V = (Y nxn )® d by the diagonal conjugation: 

g-(Ai,...,A d ) = (gAig^^.^gAdg- 1 ) 

for g G G and A\, . . . , Ad in F rix ™. The coordinate algebra of V is the polynomial 
ring 

R = ¥[xij(k) 1 1 < i,j < n, 1 < k < d\ 

in n 2 d variables. The ring R is generated by the entries of generic matrices — 
(xij(k))i<i_j< n (1 < k < d). The action of G on V induces the action on R as 
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follows: 

g ■ Xij(k) = (i,j) th entry of g~ x X k g. 

Denote by R G the algebra of matrix G-invariants, where 

/ G R G iff g ■ f = f for all g E G. 

Consider an arbitrary n x n matrix X. Denote coefficients in the characteristic 
polynomial of X by <r t (X), i.e., 

n 

det(X + XE)=Y^ A n -V t (X). 
t=o 

So, a a {X) = 1, o-i(X) = tr(X) and oy,(X) = det(JT). 

The following definitions were given in [10]. Let M be the monoid (without 
unity) freely generated by letters 

• x\, . . . ,xa, if G = GL(n); 

• xi, Xd, xj, Xj, otherwise. 

Assume that a — a\ ■ ■ ■ a r and b are elements of .M, where oi, . . . , a r are letters. 

• Introduce an involution T on M as follows. If G = GL(n), then a T = a. 
Otherwise, define b TT = b for a letter b and a T = ■ ■ ■ af E A4. 

• We say that a and b are cyclic equivalent and write a ~ 6 if there exists a 
cyclic permutation n & S r such that a^i) • • • a,r(r) = b. If a ~ 6 or a ~ 6 T , 
then we say that a and b are equivalent and write a ~ 6. 

An element from A4 is called primitive if it is not equal to the power of a shorter 
monomial. 

• Let J\f C M. be the subset of primitive elements. 

• Let M a be a ring with unity of (commutative) polynomials over F freely 
generated by "symbolic" elements cr t (a), where t > and a E JV ranges 
over ^-equivalence classes. 

We will use the following conventions: do (a) = 1 and cr\(d) = tr(a), where a E J\f. 
For a letter b E M define 

{X k , tfb = x k 
Xl, iib = xl and G = 0(n) . 
XI, if b = x\ and G = Sp(n) 

Given a = ai- ■ ■ a r E Ai, where is a letter, we set X a = X ai ■ ■ ■ X CLr . It is 
known that the algebra of matrix G-invariants R G C R is generated over F by 
a t (X a ), where 1 < t < n and a E Af. These results were established in [IS], [T2] in 
characteristic zero case and in [3], [T7] in the general case. Note that if in the case 
of p = we drop the restriction that a is primitive, then it is enough to take tr(X a ) 
instead of a t (X a ), 1 < t < n, in the description of generators for R G . Relations 
between the mentioned generators were established by Razmyslov [13] , Procesi [12] 
in case p = and Zubkov [16] in case G = GL(n) and p > 0. 
Consider a surjective homomorphism 

■ A/"cr 5" R G 

defined by at (a) — > a t (X a ), if t < n, and a t (a) —> otherwise. Note that for any 
n x n matrices A, B over R and 1 < t < n we have at(A s ) = at(A), (A s ) s = A, and 
(AB) 5 = B S A S , where S stands for the transposition or symplectic transposition. 
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Hence, the map is well denned. Its kernel K n is the ideal of relations for R G . 
Elements of 

= pi Ki 

i>0 

are called free relations. In other words, a relation between the above mentioned 
generators for R is called free if it is valid for nxn generic matrices for an arbitrary 
n > 0. In characteristic zero case all free relations are zero (for example, see [H]). 
We generalize this result to the case of arbitrary characteristic different from two: 

Theorem 1.1. If G is 0(n) or Sp(n) and p ^ 2, then the ideal of free relations 
for R is zero. 

This theorem is proven at the end of Section [S] As a consequence, we obtain an 
independent proof of the result by Donkin [3] that for an arbitrary p there is no 
free relations for i? GL (") (see Remark l5.5p . The following conjecture is discussed in 
Remark 15.61 

Conjecture 1.2. If p = 2, then the ideal of free relations for R$P( n > is 
generated by <xt(a) for a £ M satisfying a ~ a T and odd t > 0. 

Applying Theorem 11.11 to Theorem 1 . 1 from [10] , which was proved using an 
approach from [5D] , we complete the description of relations between generators for 

RO (n). 

Theorem 1.3. If G = 0(n), then the ideal of relations K n for ~J\f a /K n is 

generated by crt, r {a,b,c), where t + 2r > n (t,r >0) and a,b,c are linear combina- 
tions of elements from M. . 

The exact definition of at, r (a, b, c) £ M a can be found in Section 3 of [10]. Note that 
the function o~t, r was introduced by Zubkov in 20J and it relates to the determinant- 
pfaffian from [5] in the same way as at relates to the determinant. More details 
on the different approaches to the definition of o~ t .r can be found in Section 1.3 
of [25]. Let us remark that the definition of cr tjr from [TU] is slightly different from 
the original definition from [5D] (see Lemma 7.14 of [TU] for details). 

The description of relations for R°( n > was applied to the special case of n = 3 
in [8] and [9]. 

1.2. Mixed representations of quivers. The notion of supermixed representa- 
tions of a quiver was introduced by Zubkov [18] and [19]. It is equivalent to the 
notion of representations of a signed quiver considered by Shmelkin in [141 . Or- 
thogonal and symplectic representations of symmetric quivers studied by Derksen 
and Weyman in [2] as well as mixed representations of quivers are partial cases of 
supermixed representations. More details can be found in Section 2.1 of [7]. 

Section [S] is dedicated to the algebra of invariants i(Q,n,i) of mixed represen- 
tations of a quiver Q. As example, a special case of I(Q,n,i) is the algebra of 
invariants of bilinear forms on vector spaces V = F" and V* under the action of 
GL(n) as base change (see Example 16. 3p . 

Zubkov established generators for I(Q,n,i) in [19] and described relations be- 
tween generators modulo free relations in [20j . In Lemma 16.11 we show that there 
are no non-zero free relations for I(Q, n, i) and in Theorem l6.2l we complete the de- 
scription of relations for J(Q,n,i). Applying Theorem 16.21 in upcoming paper [11] 
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we will explicitly describe a minimal generating set for invariants of bilinear forms 
in dimension two case. 

2. Auxiliaries 

Denote the degree of a G A4 by dega, the degree of a in a letter b (i.e., the 
number of appearances of the letters b and b T in a) by degf, a. For t > we set 
deg er t (a) = t deg a and define deg / for a monomial / G A/" CT in the natural way. 

Assume that m is a positive integer. Given i G Z, we write |i| m for 1 < j < m 
such that i = j (mod m). 

Definition 2.1 (of l-subword). Assume that a = a% ■ ■ ■ a r , b = b\ • ■ ■ b s G A4, and 
I > 0, where <Zj, bj are letters for all i,j. We say that 

• a is an l-subword of b, if = &|;+i_i| s for all 1 < i < r; 

• a is an l T -subword of 6, if a,; = for all 1 < i < r. 

As an example, for a = X1X2X3X4 G yVf we have that X3X4X1 is a 3-subword of 
a and 0:^X4 is an l T -subword of a. 

Remark 2.2. If a ~ b for a, 6 € A4, then a is an Z-subword of b or Z T -subword of b 
for some / > 0. 

Lemma 2.3. Let b, c G M. Then 

a) i/ be — cb, then there is an e G M. such that b = e l and c = e J for some 
i,j > 0. 

b) if b — b T , then b — cc T for a c G M. . 

Proof, a) The proof is by induction on deg b + deg c > 1. If deg b + deg c = 2, then 
b = c is a letter and the statement is valid. 

If deg b = deg c, then b — c and the required is proven. Otherwise, without loss 
of generality we can assume that deg b > degc. Then b = cb\ for a b\ G M. Thus, 
b\c = cb\. Induction hypothesis completes the proof. 

b) The proof is by induction on deg b > 0. If b is a letter, then b ^ b T . Otherwise, 
b — yb\ for a letter y and b\ G M. Since yfei — bJy T , we have &i = &22/ T for a 
62 £ Ali. Then 62 = b\ and the induction hypothesis implies &2 = cc T for a 
c G A4i- Therefore, b = yc(yc) T . □ 

Lemma 2.4. Assume that a G A/" wii/i dega = r and 1 < Z < r. Then 

a) a is an l-subword of a if and only if I = 1; 

c 

b) if a ^ a T , then a is not an l T -subword of a; 

c) a ~ a T if and only if there exists a b G M satisfying a ~ b and b = b T ; 

d) if a — a T , then a is an l T -subword of a if and only if I = r. 

Proof, a) If a is an Z-subword of a for 1 < I < m, then there are ai, 02 G M. such 
that a — a\02 and aia2 = a2ai. Part a) of Lemma 12.31 implies a contradiction. 

b) If a is an Z T -subword of a, then a = 0102 for ai,a2 G A^i satisfying a\02 — 
a^aj. Thus ai = af and, by part b) of Lemma [2.31 at = Cicf for ci,C2 G Aii 
(i = 1,2). Therefore, a = c\c{ C2C2 ~ a ; a contradiction. 
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c) Since a ~ a T , we have a — a\a2 for ai,a2 G .Mi satisfying a\a,2 — afa^. 
As in the proof of part b), we obtain a — c\c\c2C^, where ci,C2 G M.i. Then 
b = c[c2(cfc2) T satisfies the required condition. 

d) Let a = a T and a be an / T -subword of a for 1 < I < m. As in the proof of 
part b), we obtain a = Cicfc2cl\ where ci,C2 G A4. Then for hi = CicJ (i — 1,2) 
we have &162 = &2&i- Part a) of Lemma 12.31 implies that a = 6162 is not primitive; 
a contradiction. □ 

3. Derivations 

In this section we assume that G is 0(n) or Sp(n). Given q > 0, we set 
R = R® ¥[yij(k,q) 1 < i, j < n, 1 < k < d, q > 0] and Yfe i<3 = (£%(&, q))i<i,j< n - 
Let G act on R by the same way as on R: 

9 ■ Vij( k ,q) = (i,j) th entr y of g^Y^g. 
Define a linear map d q : R — > R as follows: given an / G R, we have 

W) = E E d!i{k) Vij{k,ql 

k=ll<i,j<n %J y ' 

where q§~qa stands for the partial derivation. As an example, if / = 
En(l) 2te(2, r), then 

0,(/)= 2/ii (1,3) 2/22(2, r) and = 0. 

For an n x n matrix A = (fij)i<i,j<n over i? we set d q (A) = {d q {fij))i<i,j< n - 
Obviously, d q {X k ) = Y k , q , d q {Y k , r ) = and d q {A T ) = d q {A) T for q,r > 0. 

Remark 3.1. The linear map d q has the usual properties of the derivation. Namely, 
if /, h G R and m > 0, then 

a (/>O = + fd q (h) and 5 ? (/ m ) = m/" 1 " 1 ^/). 

Lemma 3.2. For any nxn matrices A, B over R and q > the following properties 
hold: 

a) d q {AB) = d q (A)B + A 8 q {B); 

b) d g (a t (A)) = E»to (~ 1 ) i tr(A*S g (A)) <r t _i_i (A) for alll<t<n. 

Proof. For short, we write d for d q . Let v4 = (fij)i<i,j<n and £? = (hij)i<ij< n . 
Remark [3~T1 implies that (i,j) th entry of d(AB) is equal to 

n 

E ( d (fik) h kj + fikd(h kj )) . 
k=l 

Hence, part a) is proven. Since 

(!) cr*(^)= E E S S n ( T )/ii.Mi) •••/n,ir(*)5 

l<ii<---<i t <n rGSt 

Remark 13.11 implies that <9(<7t(A)) is the coefficient of A*~ x /i in the polynomial 
<7t(AA + /zt?(vl)) in A, /i. Amitsur's formula from Q] completes the proof of part b). 

□ 
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Example 3.3. Applying Lemma [321 we obtain the next equalities. 
. Let / - a 2 {X t ). Then d q (f) = -trp^Xi) + ti(X 1 )tv(Y lq ). 

• Let / = tr(Xi) 2 tr(XiJr 2 ) and p = 2. Then = tr^) 2 tv{Y 11 X 2 ) + 
tr(X 1 ) 2 tr(X 1 y 21 ) and d 2 d 1 (f) = tr ( X ^ 2 tr (Y U Y 22 ) + triX,) 2 tr(Y 12 Y 21 ). 
Note that =0. 

Similarly to Ai, M,M a , we introduce the following notions. 

• For q > we denote by M (q) the monoid (without unity) freely generated 
by letters Xk,x"[ ,2/fcs,2/J s , where 1 < k < d and 1 < s < q, and set Ai = 
U g > -M(g). Note that M(0) = Ai. 

• Define the involution T and the equivalences ~ and ~ on Ai in the same 
way as they were defined on Ai. 

• Let A^i=7WU{l} and A^f be the vector space with the basis Ai. 

• We denote by M(q) C Ai(q) and M C Ai subsets of primitive elements and 
define M a (q), M a similarly to M a . 

Define the notion of degree for Ai and M a in the same way as for Ai and M a . For 
a letter b G Ai define the n x n matrix Xb as follows: 



X b 



Yks j if b = yks 

YjFg, if b = vl s and G = 0(n) 

Y k * s , if b = yl and G = Sp(n) 

X b , iibeM 



Given letters a\,...,a r G A4, we set X ai ... Qr = X ai ■■■X ar . A homomorphism 
\& n : M a — > R G is defined by ert(a) — > a t (X a ), if < < n, and cr t (a) — >• otherwise. 
Assume that q > 0. We define a linear map d q : Aiv —> Aiw as follows: 

• d q (x k ) = y kq , d q {xl) = yl q , and d q {y ks ) = d q (y% s ) = for all 1 < k < d 
and s > 0; 

• d q (ai ■ ■ ■ a r ) = Y^i=i a i ■ ■ ' a i-i dg(ai) a,+i ■ • • a r for letters oi, . . . , a r G Ai. 
Define a linear map d q : M a {q — 1) — > M a (q) as follows: for a, a\,...,a r G 

A4(g — 1) and t,ti, . . . ,t r > 0, we set 

• d q (a) = for a G F; 

• d q (at(a)) — X)i=o(~l) l tr(a J 9 g (a)) (Tt-i-i(a), where we use the convention 
that 

tr(ai + • • • + a r ) = tr(ai) + • • • + tr(a r ); 

• 9 q (a tl (ax) ■ ■■<r tr ( a r)) = 

r 

^ CTt a (ai) • • ■ (J U _ l (ai-i) d q (a u (ai)) cr 4i+1 (oi+i) • • • a tr (a r ). 

i=l 

Since an element (ai ■ ■ • a r ) l a\ ■ ■ ■ dj-x d q (ctj) a-j+x ■ ■ ■ a r is either primitive or zero, 
where a±, . . . , a r eM(g-l) are letters, the following remark implies that the map 
d q ; M<r(q - 1) M a (q) is well defined. 



Remark 3.4. For a, b G A4 and 5 > we have 

• <9 g (a T ) = d q (a) T ; 

• if a - 6, then tr(a m <9 g (a)) = tr(b m d q (b)) for all m > 0. 
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Note that by abuse of notation we denote three different linear maps by one and 
the same symbol d q . 

Lemma 3.5. For q > the following diagram is commutative: 

d q I id q 

Z(q) ^ R G 

In particular, if f £ N a {q — 1) is a free relation (i.e., ^ n {f) = for all n > 0), 
then d q (f) £ Af a is also a free relation. 

Proof. Obviously, the statement of the lemma holds for tr(X a ), where a £ M is 
a letter. Lemma [3.21 and the definition of d q : J\f a (q — 1) — > JV a (q) complete the 
proof. □ 

In the proof of the next lemma we use statements from Section[21 which obviously 
hold for elements from A4. 

Lemma 3.6. Assume that q, s > and a £ J\f(q — 1) satisfies 

a) deg Xk (a) ^ for some 1 < k < d; 

b) a^a T . 
Let monomials 

3=1 

be pairwise different, where r*j > 0, tn > ■ ■ ■ > U ri > 1 and run, . . . ,rrii ri > are 
not divided by p (1 < i < s). Then d q (fi), . . . ,d q (f s ) are linear independent over 
F. 

Proof. Let a\d q (fi) + ■ ■ ■ + a s d q (f s ) — 0, where on £ F, be a non-trivial linear 
combination. Then without loss of generality we can assume that a, ^ for all i. 
Moreover, without loss of generality we can assume that 

tn = maxjiy}. 

For short, we denote t = t\\. We have 

d q (a) = b\-\ Yb r 

for pairwise different b\,...,b r £ N and r > 0. By the definition of d q , 

&q(fi) ^ ^ fti,wfi,wj 

where fii is equal to the set of pairs 

{(u, v, k) | I < u < Ti, < v < ti u , I < k < r}, 
fli,tu,v,k) = (~l) 1 ' m iu is non-zero, and 

fi,(u,v,k) = °'t lu (a) m ^- 1 tY(a v b k )<T tiu - v -i(a) JJ a"^ '(a). 

l<j<ri,j^u 

We claim that for i = I and wo = (1, t — 1, 1) the following statement holds: 
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If fi,w = fi ,w , then i = i and w = w - 

Assume that i and w — (u,v,k) satisfy f^ w — fi , Wo - There exists a unique 
1 < k' < d such that deg 2 (oi) = 1 for z = yk', q - The only multiplier of fi , Wa 
that contains z or z T is tr(a' _1 &i) and the only multiplier of fc w that can contain 
z or z T is tr(a v bk)- Therefore, a t ~ 1 bi ~ a v bk- The last equivalence implies that 
v = t — 1 and one of the following cases holds: 

1. o*-^! ~ o t - 1 6 fc ; 

2. a^h £ (a^bkf. 

Note that the result of the substitutions z — > Xk> , z T — > Xy in b\ as well as in bk 
is a. Thus, making these substitutions in the above equivalences, we obtain that 
a is the Z-subword of a in case 1 and a is the Z T -subword of a in case 2, where 
1 < I < dega. Part b) of Lemma T2.4I implies a contradiction in case 2. Part a) of 
Lemma T2.4I implies that I = 1 in case 1. Thus, a* _1 &i = a t ~ 1 bk and fc = 1. Since 
v < ti u < t, we obtain tj„ = i. The inequalities i^i > • • • > ti tTi imply u = 1. 
Therefore, w — w . 

It is not difficult to see that in the quotient field of A/" ff we have 

/»,«) = — fr tr ( at ~ 1& i) and f io Wo = -tr(a' _1 &i). 
a* (a) a* (a) 

Thus i = 1 and the claim is proven. Obviously, the claim implies a contradiction 
to the fact that ^ 0. The lemma is proven. □ 



Lemma 3.7. Assume that in the formulation of Lemma \3.6\ we have a ~ a T 
instead of condition b). Then 

• '/p^ 2, iften d q (f\), . . . , d q {f s ) are linear independent over F; 

• ?/p = 2, i/ien d q {fi) = /or a/Z i. 



Proof. We use notations from the formulation of Lemma 13.61 Without loss of 
generality we can assume that 

tn = max{t«}. 

For short, we denote t = t\\. By part b) of Lemma T2.3I and part c) of Lemma \2. 41 
without loss of generality we can assume that a — cc T for some c € M. We have 
d q {c) = bi + • • • + b r , where bx,,..,b r £ M are pairwise different and r > 0. By 
Remark 13.41 

d q (a) = hc T H h b r c T + cbj H + cb T r . 

Since tr(a"6fcC T ) = tr(a"c&£ ) for all 1 < k < r and v > 0, we obtain that 

& q (fi) ^ ^ fti,w fi,wj 

where fii is equal to the set of pairs 

{(u, v, k) 1 1 < u < r i: < v < t iu , 1 < k < r}, 
/3i,(u,v,k) = 2(-l) v m iu , and 

fi,(u,v,k) = < J U u (a) miu ~ 1 ti(a v b k c T )a tiu ^ v ^i(a) ^ w (a). 

i<j<n,jjiu 
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Therefore, if p — 2, then d q {fi) — for all i and the required is proven. 

Let p ^ 2. We claim that if fi >w = fi , Wo i then i — io and w — wo, where io = 1 
and wq — (1, t — 1, 1). 

Let i and w = {u,v,k) satisfy fi, w = fi . Wo - There exists a unique 1 < k' < d 
such that deg z (&i) = 1 for z = yw ,q- The only multiplier of fi 0)Wo that contains 
z or z T is tr(a*~ 1 6iC T ) and the only multiplier of fi tW that can contain z or z T 
is tr(a t '&/ s c T ). Therefore, a t ~ 1 biC T ~ a v bkC T . The last equivalence implies that 
i> = < — 1 and one of the following cases holds: 

1. a^htF ~ o*- 1 6 fc c T ; 

Note that the result of the substitutions z — > , z T — >■ x^, in &i as well as in is 
c. Making these substitutions, we obtain that a is the Z-subword of a in both cases, 
where 1 < I < dega. Part a) of Lemma T2.4I implies that 1 = 1. Since deg 2 (a) = 0, 
we obtain a contradiction in case 2 and the equality a t ~ 1 b\ = a t ~ 1 bk in case 1. 

So, we proved that k = 1. The rest of the proof of the claim is the same as in 
the proof of Lemma 13.61 and the required follows from the claim. □ 



4. p-MULTILINEAR FREE RELATIONS 

We assume that G is 0(n) or Sp(n). Let / S M a be a monomial. If p > 0, then 
we write / = / + /~ for 

(2) /+ = < ( 0l ) • • • < (a r ) and /- = (6r) • • • o* (b s ), 

where ai, . . . , a r , b\, . . . , b s 1 < qi,...,q s < p, and tr^ (&i), . . . , ai t (b s ) arc 

pairwise different elements of N a - If p = 0, then we set /+ = 1 and /~ = /. 
As example, if / = tr 5 (a;i) and p — 2, then /+ = tr 4 (xi) and / _ = tr(xi). 

Definition 4.1. Let / = J2 w ^n a wfw G A/^, where a w G F is non-zero and /„, is a 
monomial. Then / is called multilinear if deg z (f w ) < 1 for every letter z E M. and 

w e fi 

The element / is called p -multilinear if there is a subset / C {xk,yk,q 1 < & < 
d, g > 0} such that every w G f2 satisfies the following conditions: 

• deg z (/+) = and deg z (/~) < 1 for every letter z g I; 

• de Sz(fw ) = for ever y z E I. 

In this section we prove that if there is a non-zero free relation, then there exists 
a non-zero p- multilinear free relation (see Corollary 14.41 below) . 
For / as in Definition 14. II we set 

dcg + (/) = max (deg(/+)} and deg - (/) = max <^ V deg (/") 

Kk=l 

Note that for q > and a monomial / G A/" CT we have 

(3) 9 (/) - 
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The next remark follows from the definition of d q and the fact that if b r = c s for 
b, c G A4 and r, s > 0, then there is an e € M such that b — e l and c = e-' for some 
i,j > (see part a) of Lemma f2T3|) . 

Remark 4.2. Let g,t,Z > Q, a,b G A/"(q - 1), d q (a t (a)) = £\ ±/j and d q (<n{b)) = 
±hj for monomials /j, /ij. Then there exist i, j with /j = /ij if and only if a ~ 6 
and t = I. 

Lemma 4.3. Let p ^ 2 and / £ A/^. TVien there is a q > swc/i £/ia£ 3 g • • • 
is a non- zero p- multilinear element ofN a . 

Proof. Let q > 0. Consider /i = X) lu gn a whw G A/^- for non-zero elements a M G F 
and pairwise different monomials f w G A/V. Let /i be in Af a (q — 1) and 

(4) de S, fc >i) = and deg^^") < 1 

for all 1 < k < d, s > 0. Then we claim that one the following possibilities holds: 

• h is a p-multilinear; 

• h! = d q (h) is non-zero, h' satisfies condition (j4j and deg~(h') < deg~(h). 
If deg - (h) — 0, then h is p-multilinear for / = {xi, . . . , Xd}. 

We assume that deg~(h) > 0. Let {ai, . . . , a s } be a subset of Af such that for 
every ai€!lwe have 

l<i<s 

where h w-i is a product of some elements of the set {cr t (aj) 1 t > 0} or = 1. 
Given 1 < i < s, denote by Gi the set of w G f2 with deg^, ,(h~ j) ^ for some 
1 < A: < d. 

Since deg~(h) > 0, the set &i is not empty for some 1 < i < s. Using 
formula ([3]) and the equality h~ — Yii=i ii we obtain that for every w G 

(5) d q (h w ) = /i+ ^iu,i ' ' ' h w ^id q {h w i )h w i+1 ■ ■ ■ h w s , 

where the sum ranges over 1 < i < s satisfying w G G;. Note that if w $ Gj for all 
i, then d q (h w ) = 0. Applying Lemmas 13.61 and l3~7l we obtain that {d q (h~ f ) | io G 
Gi } are linear independent over F. Thus, the dehnition of /i^j together with 
Remark 14.21 implies that h! = d q (h) ^ 0. It follows from formula §5§ that h' 
satisfies condition Q and deg'(h') < deg~(h). Therefore, the claim is proven. 

Applying the claim to /, &,(/), ch(di(f)) and so on, we prove the required 
statement by induction on deg - (/). □ 

Corollary 4.4. Let G be 0(n) or Sp(n) and p / 2. Assume that f G N a is a 
non-zero free relation and d ;>> is large enough. Then there exists a non-zero 
p -multilinear free relation h G M a with deg + (/i) < deg + (/). 

Proof. Applying Lemma T4.31 we obtain q > such that /' = d q ■ ■ ■ di(f) is a non- 
zero p- multilinear element of M a - By Lemma l3~5l /' is a free relation. Equality ^ 
implies that deg + (/') < deg + (/). 

Let /' = 53 a ifi f° r non-zero ai G F and pairwise different monomials fj. Since d 
is large enough, there is an injective map ip from the set oiyts satisfying deg yfcs ( fi) ^ 
for some i (1 < k < d, s > 0) to the set of Xj satisfying deg x . (fi) = for all 
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i (1 < i < d). Making substitutions yts -> viVks) and y£ a -¥ tp(yk s ) T in /', wc 
obtain the required ft. G A/^. □ 

5. Multilinear free relations 

We assume that G is 0(n) or Sp(n). Given annxn matrix A = {fij)\<i.j< n 
over i?, we denote 

A (p) = (/g)i<M<«. 

Remark 5.1. Let ^4 be a commutative F-algebra and p > 0. Then for oi, . . . , a r £ 
A we have (ai + • • ■ + a r ) p = + ■ • • + af!. 

Lemma 5.2. For n x n matrices A and B over R the following properties hold: 

a) (AB)W =iWBW; 

b) <T t {A) p = o- t (A^) forl<t< n; 

c) i/n is ewn, then (A*)& = (A&))*. 

Proof. We set A = (/y)i<i,j<n and £? = (/iy)i<i,j<n- Then (i, j) th entry of 

^ s (Efe=i fikhkjY and Remark 1 5 . 1 1 completes the proof of part a). Part b) follows 

from formula §\§ and Remark l5.ll Part c) follows from part a). □ 



Lemma 5.3. Assume that p =£2, f £ M a is a non-zero p -multilinear free relation 
and d is large enough. Then there exists a non-zero multilinear free relation 
in M a - 

Proof. Without loss of generality we can assume that p > 0. Let / = J2wen a wfw £ 
M a be not multilinear, where a w £ ¥ is non-zero and f w is a monomial. Note that 
fw = f° r some h w £ M a . Definition 14.11 implies that there is a set I C {1, . . . , d} 
such that for every w the element /+ "depends" only on {xk \ k £ 1} whereas /~ 
"depends" only on {xk \ k €" I}. Hence h = J2 w efi aw ^ w fw i s a non-zero element 
of M a satisfying deg + (ft) < dcg + (/). 

Given n > 0, we have ^ n (f) = 0. By Remark IBTTl \E , n (/i p ) is a polynomial in 
Xij(k), where k £ I and 1 < i,j < n. It follows from Lemma [5.21 that the result 
of substitution x^{k) — > Xij(k) (k £ I, 1 < i,j < n) in \l/„(/iP) is ^ n (h w ). Thus, 
applying the mentioned substitution to ^ n {f) = we obtain \l/„(/i) = 0. Therefore, 
h is a free relation. 

Applying Corollary 14.41 to h, we obtain a non-zero p- multilinear free relation /' 
satisfying deg + (/') < deg + (h). Repeating this procedure several times and using 
the fact that deg + (/) decreases at each step by at least one, we finally obtain a 
non-zero multilinear free relation. □ 



Lemma 5.4. There is no a non-zero multilinear free relation in M a for p > 0. 

Proof. We assume that / = Ylwen a wfw £ Ma is a non-zero multilinear free relation 
for non-zero a w £ ¥ and pairwise different monomials f w . Since F is infinite, 
without loss of generality we can assume that / is homogeneous with respect to 
N d -grading of M a , i.e., &eg Xl (f w ) =■■■ = deg Xd (f w ) = 1 for all w. 

We set n = d in case G is the orthogonal group and n = 2d in case G is the 
symplectic group. Denote by e^j the n x n matrix whose entry is 1 and 

any other entry is 0. Let u £ Q and /„ = tr(ai) • • • tr(a r ) for some a%, . . . , a r £ M. 
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Given a\ — z\- ■ ■ z s , 0,2 = z s +i • • • Zi, and so on, where zi, . . . , Zi are letters, we 
set Zi = e^i+i for 1 < i < s and Z s = e Sj i. Similarly, we define Zi = e^i+i for 
s + 1 < i < I and Zi — e; tS _|_x • Considering 03, . . . , a r , we define Z\ for all I < i < d 
as above. 

Note that in the symplectic case e*j = ej+ds+d for 1 < i,j ' < d. Hence in both 
cases the result of substitutions 

Xij{k) -> (i,j) th entry of Z k (1 < k < d) 

in ^ n (f w ) is zero for w 7^ u and one for w — u. Since / is a free relation, we have 
^n(f) — 0. Thus we obtain a u = 0; a contradiction. □ 

We now can prove Theorem ll.lt 

Proof. Let / be a non-zero free relation. Obviously, without loss of generality we 
can assume that d is large enough. Then Corollary 14.41 and Lemmas 15.31 15.41 imply 
a contradiction. □ 



Remark 5.5. In case G = GL(n) we can repeat the proof of Theorem 1 1 . 1 1 without 
reference to Lemma \3. 71 where the restriction p ^ 2 is essential. As the result, we 
obtain that there is no free relations for i? Gi (™) for an arbitrary p. 

Remark 5.6. Let p = 2 and G = Sp(n). By straightforward calculations we can 
see that tr(AA*) = for every nxn matrix A over R. By part b) of Lemma |2~31 and 
part c) of Lemma \2. 41 elements tr(a) € J\f a with a ~ a T are free relations. On the 
other hand, it is not difficult to see that a-iixixj) is not a free relation (1 < i < d). 

6. Invariants of mixed representations of quivers 

A quiver Q = (Qq, Q\) is a finite oriented graph, where Qq (Qi, respectively) 
stands for the set of vertices (the set of arrows, respectively). For an arrow a, 
denote by a' its head and by a" its tail. We say that a — a\ ■ ■ ■ a r is a path in 
Q (where 01, . . . , a r € Qi), if a" = a' 2 , ■ ■ ■ , a"-i = a 'r- The head of the path a is 
a' = a[ and the tail is a" = a". A path a is called closed if a' = a" . 

Given a dimension vector n = (n v \v G Qo); we consider 

. the space H = £ aeQl F"*'*».« ~ £ a£Qi Hom(F"«",F*v); 

• the coordinate ring R = ¥[xfj | a € Qi, 1 < i < n a >, 1 < j < n a >>] of H: 

• the n a i x n a n generic matrix X a = (xfj) for every o£ Qi; 

• the group GL(n) — XX>eQ GL(n v ), acting on H as the base change, i.e., 

9-{K) = (9a'h a g~,}) 

for g = (g v ) G GL(n) and (h a ) G H; this action induces the action of 
GL{n) on R. 

Given a path a = a\ ■ ■ ■ a r with o, G Qi, we write X a for X ai ■ ■ ■ X ar . Donkin [5] 
proved that the algebra of invariants of representations of Q 

I(Q,n)^R GL ^ 

is the subalgebra of R generated by at{X a ), where a is a closed path in Q and 
1 < t < n a i . Moreover, we can assume that a is primitive, i.e., is not equal to the 
power of a shorter closed path in Q. 
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Let 1 : Qo Qo be an involution, i.e., i 2 is the identical map, satisfying i(v) ^ v 
and = n v for every vertex v £ Qo- Define 

• the group GL(n,i) C GL(n) by (g v ) £ GL{n,x) if and only if Qvgfu,) = ^ 
for all v; 

• the double quiver Q D by Q^ — Qo and Qf = Qi ]J{a T \ a e Qi}, where 
(a T )' = i(a"), (a T )" = i(a') for all a G &. 

We set X a T = Aj for all oG Si. Zubkov [19] showed that the algebra of invariants 
of mixed representations of Q 

I(Q, n, i) = i? GL ( rt > 1 ) 

is the subalgebra of i? generated by <j t (X a ), where a is a closed path in Q D and 
1 < t < n Q '. As above, we can assume that a is primitive. An example of mixed 
representations of a quiver is given at the end of the section. 

Let Q, n, i be as above. We write A4(Q, i) for the set of all closed paths in Q D 
and A/"(Q,i) for the subset of primitive paths. Given a path a in Q D , we define 
the path a T in Q D and introduce ^-equivalence on Ai(Q, i) in the same way as 
in Section [T] Denote by Mw(Q, i) the vector space with the basis ^(2,1) and 
define Af a (Q,i) in the same way as Af a have been defined in Section [T] Consider a 
surjective homomorphism 

T n :7V;(Q,i)^7(Q,n,i) 

defined by er t (a) — > a t (X a ), if t < n a >, and a t {a) — > otherwise. Its kernel K n (Q, i) 
is the ideal of relations for I(Q, n, l). Elements of K(Q,i) = rim>o^" l (2: 1 ) are 
called /ree relations for I(Q, n, i). 

Let u,v € Qo be vertices. We say that a g A4f(Q, i) goes from u to u if 
a = J2i a i a i> where a; € F and e A / ((Q,i) satisfies a" = u, = v. If a goes 
from u to u, then we say that a is incident to it. 

Lemma 6.1. The ideal K(Q,i) of free relations for I(Q,n,i) is zero for an arbi- 
trary p. 

Proof. If / is a free relation, then / e K m (Q,i) for a dimension vector m — 
(to, . . . , m) of Q, where m > is arbitrary. By part b) of Lemma 12.31 and part c) 
of Lemma 12.41 there does not exist a closed path a in OP with a ~ a . Hence / 
does not contain a summand with a multiplier at (a), where a is a closed path in 
Q D with a ~ a T and t > 0. 

Exactly in the same way as we proved Theorem 1 1.1 1 for G = 0(m), we can show 
that / = 0. Here we do not use the first part of Lemma [5771 which holds for p = 2, 
but we only need Lemma l3.6i which holds for an arbitrary p. □ 

Let us recall that the definition of at,r can be found in Section 3 of [TU] . 

Theorem 6.2. The ideal of relations K n (Q,i) for I(Q,n,i) ~ Af ff (Q,i) /K „(Q,i) 
is generated by 

a t , r (a,b,c) 6JV„(S,i), 

where t + 2r > n v (t, r > a, 6, c G A^f(Q, i) } a is incident to some vertex v € Qo, 
b goes from i(v) to v, c goes from v to i(v). 
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Proof. As in [20] , we denote by J(Q,i) the inverse limit of algebras 

{/(Q,n(l),i),^ n(1) ,„ (2) |n(l) > n(2)}, 

where <£Wi),n(2) : -^(Q, ^(1), i) — ► ^(Qi n (2),i) is the natural epimorphism. It is not 
difficult to see that J(Q,i) ~ A^(Q, i)/if(Q,i). Lemma IBTTl implies that J(Q,i) ~ 
A/"cr(Q,i). By Theorem 2 of [20], the kernel of the natural epimorphism J(Q, i) — >• 
I(Q,n,i) is generated by elements from Theorem 16.21 □ 

Example 6.3. Let (•, -)i, ...,(•, -) r be bilinear forms on V — F" defined bynxn 
matrices A\, . . . , A r and (•, ...,(•, -) s be bilinear forms on the dual space V* 
defined bynxn matrices Bi, . . . ,B S . Then G = GL(n) acts on the space 

r s 
k=l 1=1 

of the above mentioned bilinear forms as base change: 

g-(A u ...,A r ,Bi,...,B a ) = (gA l9 T , gA r g T , g~ T Big" 1 , . . ..g^Bsg" 1 ), 

where g~ T stands for (g T ) -1 . This action induces the action of GL(n) on the 
coordinate ring 

¥[H] = ¥[ Xij {k), yij {l), 1 1 < i, j < n, 1 < k < r, 1 < I < a]. 

Denote generic matrices by — (xij(k)) and Yi = (yij(l))- Let Q be the following 
quiver 



bi,...,b, 

where there are r arrows from v to u and s arrows in the opposite direction, i(u) = 
v, and n = (n,n). Then the algebra of invariants ¥[H] GL ^ is isomorphic to 
I(Q, n, l). By the above mentioned result of Zubkov 19 , ¥[H] GL ^ is generated 
by <Jt(Z\ ■ ■ ■ Z m ), where 1 < t < n and Zi is one of the following products: 

X k Y h XlY h X k Y?, X T k Y? (l<k<r,l<l<s). 

Relations between these generators are described by Theorem 16.21 
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